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We study the effect of regime switches on finite size Lyapunov exponents (FSLEs) in determining the error 
growth rates and predictability of multiscale systems. We consider a dynamical system involving slow and 
fast regimes and switches between them. The surprising result is that due to the presence of regimes the 
error growth rate can be a non-monotonic function of initial error amplitude. In particular, troughs in the 
large scales of FSLE spectra is shown to be a signature of slow regimes, whereas fast regimes are shown 
to cause large peaks in the spectra where error growth rates far exceed those estimated from the maximal 
Lyapunov exponent. We present analytical results explaining these signatures and corroborate them with 
numerical simulations. We show further that these peaks disappear in stochastic parametrizations of the fast 
chaotic processes, and the associated FSLE spectra reveal that large scale predictability properties of the full 
deterministic model are well approximated whereas small scale features are not properly resolved. 
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The atmosphere and the climate system are in- 
herently complex multiscale systems with pro- 
cesses spanning spatial scales from millimetres 
to thousands of kilometres, and temporal scales 
from seconds to millennia. It is a formidable chal- 
lenge to find consistent and eflfective reduced dy- 
namical equations for the "slow" and "large" de- 
grees of freedom with predictive power. An im- 
portant question is how to measure the radius of 
predictability in such a multiscale system. One 
such measure is the maximal Lyapunov exponent 
Ainax- A generic situation is that the fast degrees 
are strongly chaotic, causing the Lyapunov expo- 
nent of the whole system to be large, indicating 
poor predictability. However, the large scale slow 
behaviour can still be forecast with reasonable ac- 
curacy for times much longer than ©(l/Amax); for 
example, weather can be forecast on time scales 
above those expected from small-scale instabili- 
ties such as convection^^. This is usually due to 
the small-scale instabilities growing faster but be- 
coming nonlinearly saturated at a much smaller 
level than large scale instabilities. 



I. INTRODUCTION 

In a series of papers Aurell et ai— and Boffetta et al.^'^ 
introduced the Finite Size Lyapunov Exponent (FSLE) to 
extend the idea of measuring the divergence of nearby 
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trajectories to resolve predictability measures for pro- 
cesses developing on various scales. FSLEs have been 
successfully used in recent years to study mixing and 
transport problems in lakes^i and ocean currents^, and 
to study meso-scale and sub-mesoscale filamentary pro- 
cesses in the surface circulationi^ii^i^^. 

The study of error growth rates has also led 
independently^li^^ to the development of breeding vectors 
to produce optimal perturbations for ensemble forecast- 
ing. The average growth rate of these vectors is closely re- 
lated to the FSLE^i^. Besides studying predictability^i^ 
optimal finite-size perturbations have been used in en- 
semble forecasting2L2^ and data assimilation^^ where 
they should represent the directions of growing analy- 
sis errors, which are again scale dependent. Hence, the 
question of how error growth rates depend on initial error 
amplitude is integral to the generation of perturbation 
ensembles for ensemble forecasting and data assimilation. 

The particular aspect we address here is how to inter- 
pret the FSLE spectrum in a multiscale dynamical sys- 
tem which involves abrupt switches between regimes. We 
study a system which involves both slow and fast regimes. 
The meaning of "slow" depends on the context; synop- 
tic weather systems such as high and low pressure fields 
are slow when compared to gravity waves, the buoyancy 
oscillations of stratification surfaces of the atmosphere. 
However, weather itself is fast when it comes to climate 
modelling in coupled ocean-atmosphere models, where 
the ocean evolves on a much slower time scale than the 
atmosphere. 

Slow weather regimes have long been associated with 
climate. In the atmosphere they can be associated with 
zonal and blocked flows dominating weather on time 
scales up to several weeks2i2i. Atmospheric slow regimes 
are responsible for low-frequency variability of planetary 
scale dynamics^iSl, the Arctic Oscillation and North- 
Atlantic Oscillation (NAO), the dominant pattern of at- 
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mospheric variability over the Atlantic^^. In the ocean 
slow regimes have been associated with low-frequency 
variability of the thermohaline circulation and ENSO^^. 
On paleoclimatic scales slow regimes distinguish glacial 
and interglacial periodsiii^^. 

Fast regimes have recently been considered to be 
highly relevant for atmospheric and climatic variabil- 
ity, and may determine predictability of dominant slower 
processes. For example, synoptic weather events such 
as Rossby-wave breaking and high-latitude blocking 
episodes with life times of 5-10 days are important for the 
NAO and may give rise to its low-frequency variability 
on interannual and longer time scalesiii^. Similarly, the 
ENSO variability on time scales of seasons to years can be 
produced or maintained by faster subseasonal long-lived 
transient westerly wind bursts and the Madden- Julian 
Oscillation with life times of 30-90 dayi^^'^^. On the 
mesoscale, fast mesovortices with life times of a few hours 
can dampen the intensification of hurricanes by mixing 
heat and momenturo2£. 

We investigate a low-dimensional toy model describ- 
ing one slow metastable degree of freedom coupled to 
a fast chaotic system. To study the influence of fast 
regimes, the slow variable will be coupled to two types 
of fast dynamics, the Lorenz-63 system which involves 
regimes and the Rossler system which does not. The 
deterministic system under consideration is amenable to 
stochastic singular perturbation theory (for both types of 
fast dynamics) which allows us to effectively describe the 
slow dynamics in a dimension-reduced stochastic model, 
which supports the same slow regimes. We will show that 
the presence of slow metastable states causes the FSLE 
spectrum to have a pronounced trough at large scales. 
Fast regimes, on the other hand, may cause the FSLE 
spectrum to exhibit large peaks. We develop a quantita- 
tive theory which explains both phenomena. 

The paper is organized as follows. In Section |TT] we 
briefly introduce the FSLE. The toy model under consid- 
eration is introduced in Section lllll Numerically obtained 
FSLE spectra of the model are presented in Section IIVI 
The signatures of slow metastable states on the FSLE 
spectra is explained analytically in Section [V Al using the 
multimodal probability density function of the slow vari- 
ables. The signature of fast regimes on the FSLE spectra 
is quantitatively explained by means of a heuristic argu- 
ment in Section IV Bl We conclude with a discussion in 
Section ED 

II. FINITE SIZE LYAPUNOV EXPONENTS 

The finite size Lyapunov exponent (FSLE) introduced 
by Aurell et al.^ and Boffetta et al.^-^ measures the 
growth rate of a perturbation of finite size 5. The FSLE 
A(i5) is defined as 




where Tr{S) is the time taken for a perturbation of size 
6 to grow by an amplification factor r, which we take to 
be r = 1.1 throughout. The first average < • >^ is taken 
over the invariant measure of the dynamics which is ap- 
proximated by the ensemble average < • >ons over many 
realizations. To compute the FSLE spectrum, i.e. A as 
a function of 6, numerically, two trajectories are created 
starting with an initial separation So, and the separation 
S is measured as the trajectories diverge over time. The 
perturbations S are assumed to be already aligned with 
the most unstable direction, which is guaranteed by ini- 
tializing each realization with a sufficiently small initial 
perturbation size Sq. Note that the small-scale FSLE 
with (5 — > corresponds to the maximal Lyapunov expo- 
nent Amax- 



III. THE MODEL 

We study multiscale systems of the form 

J = ax(i,»-i^) + i/fa) (2) 
14*), (3) 

in which a slow degree of freedom a; G M describes an 
overdamped degree of freedom in a double- well potential 

V{x)=a^~ab'^, (4) 

which is driven by a fast chaotic process y G M'^. The 
parameter b controls the location of the slow metastable 
states near x* — ±6 and their separation 2b. The height 
of the potential barrier AV{x) = ab'^/A is controlled 
by both a and b. Unless otherwise specified, we set 
a & = 1, and = o.Ol. 

We consider three cases: where the fast subsystem 
is given by A.) the chaotic Lorenz-63 system, B.) the 
chaotic Rossler system and C.) a reduced stochastic sys- 
tem which we derive to describe the statistics of the ef- 
fective slow dynamics only. The slow x-dynamics sup- 
ports slow metastable states near x* = ±6 in all three 
cases. However, only the Lorenz-63 system supports fast 
regimes. 

Figure [T] shows a sample trajectory of the slow variable 
X for the Lorenz-driven system (see ([S])-® below) which 
clearly shows how the fast chaotic process causes the 
slow variable to switch between regimes centred around 
X* = ±1. Simulations of the Rossler-driven system and of 
the reduced stochastic system exhibit qualitatively simi- 
lar behaviour. 
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FIG. 1. Sample trajectory of the metastable slow variable x 
calculated from the system ([5|-(l8|. 



A. Fast Lorenz-63 subsystem with regimes 



We consider the multiscale model ©-([S]) when the slow 
dynamics is driven by a fast Lorcnz-63 subsystem 



dx 
It 
dyi 
dt 

dm. 

dt 
dm 
dt 



k 

-V2 

e 



10 



— = ^(y2-yi) 
~iT ^ ^(2^2/1 - y2 - 2/12/3) 

1 8 
— (2/12/2 - 0^3) • 



(5) 
(6) 
(7) 
(8) 



This system was introduced by Givon et ai— and has 
been further analyzed by Mitchell and Gottwald— . We 
use here k = 4/90 which produces an autocorrelation 
decay time of the slow variable Tcon- ~ 208 time units. 
The maximal Lyapunov exponent is estimated as 
Amax ~ 97.4 and scales with e^, the time scale of the 
fast dynamics. This exemplifies the discrepancy between 
large scale predictability as measured by r^orr and the 
inverse of the maximal Lyapunov exponent. 



The fast dynamics contains regimes consisting of 
the two respective lobes of the butterfly attractor and 
abrupt switches between them. We remark that strictly 
the metastable states of the Lorenz-63 system do not 
consist of the lobes of the butterfly attractor, but involve 
parts of the attractor from both lobes, separated by 
the stable manifold of the lowest period symmetric 
unstable periodic orbilii^. Here however, we use the 
common terminology of regimes, meaning the lobes of 
the butterfly attractor. 



B. Fast Rossler subsystem with no regimes 

Further, we consider the multiscale model ([2])- ([31) when 
the slow dynamics is driven by a fast Rossler subsystem 



dx o ^ / — \ 

= x-x + - 2/2 - 2/2) 
at £ 

dyi 1 

dt 

=| = 1(«H- 0.432,., 

dys 1 



.2 (-2/2 - 2/3) 



dt 



(2 + 2/3(2/1-4)) . 



(9) 
(10) 

(11) 
(12) 



Unlike the Lorenz-63 system, the fast Rossler system 
has only one unstable fixed point and does not support 
regimes. The coupling is chosen so that the forcing has 
mean zero; the mean of the driving Rossler variable 
was estimated as y2 ~ —0.939 from a long trajectory. 
We chose the coupling parameter k = 0.525, which 
corresponds to an autocorrelation decay time of the 
slow variable Tcorr ~ 234 time units, comparable to that 
calculated for the Lorenz-driven system. The maximal 
Lyapunov exponent for the fast subsystem is measured 
to be Aniax = 10.12, scaling again with e^. 



C. Reduced homogenized stochastic slow dynamics 



The 
using 



multiscale 
stochastic 



(homogenization) 



system (H])-© can be reduced 
singular perturbation theory 
— in the case that the fast dy- 
namics is mixing and the average of the slow vectorfield 
f{y) over the ergodic measure induced by the fast 
process vanishes. Ergodicity and the mixing property 
have been rigorously proven for the chaotic Lorenz-63 
syste m^^'^^ , and numerical simulations suggest that 
they exist for the Rossler system as well. The centering 
condition of the vanishing average of the fast vectorfield 
f{y) is automatically satisfied for the Lorenz-driven 
system (O-® since the average of 2/2 is zero, and by 
construction for the Rossler-driven system ©-(US]) for 
sufficiently accurate numerical estimates of the average 

In stochastic homogenization the fast chaotic degrees 
of freedom are parametrized by a stochastic process, pro- 
vided the fast processes decorrelate rapidly enough that 
the slow variables experience the sum of uncorrelated fast 
dynamics during one slow time unit. According to the 
(weak) Central Limit Theorem this corresponds to ap- 
proximate Gaussian noise. Applying homogenization the 
following reduced stochastic model can be deduced for 
the sfow x-dynamics 



(13) 



with one-dimensional Wiener process dW , and where a 
is given by the integral of the autocorrelation function of 
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the fast 1/2 variable with 

— =fcM { lim - / y2is)y2{t + s)ds}dt. (14) 

In the case of the Lorenz-driven system ©-([H]) the 
diffusion coefficient is estimated as — 0.113 from a 
long-time trajectory, for which the decay time of the 
autocorrelation function is Tcorr ~ 222 time units. For 
details the reader is referred to Refs. [H and[29l 

Whereas the invariant ergodic probability density func- 
tions can only be numerically estimated for the determin- 
istic equations ©-(HI) and (|9l)- (fT2|) . it is readily analyt- 
ically determined for the stochastic gradient Langevin 
equation as the unique stationary solution p{x) of 
its associated Fokker-Planck equation 

d , , d fdV \ (T^ 92 

We find 

p[n,) = Ae-^^(") with Z = / e-^^(")da; , 
Z J -00 

(15) 

which is depicted in Figure [2] 

In Figure [5] we show the empirical probability density 
functions of the slow variable x from the Lorenz-driven 
and Rossler-driven systems ©-([S]) and ([5t- p^ obtained 
from long-time numerical simulations, as well as the ex- 
act density function (fTS]) for the stochastic system (fT3|) 
with — 0.113. For this value of ti^ the stochastic re- 
duced system approximates the statistics of the full dy- 
namics of the Lorenz-driven system ([S])-® very welP?. 
This is reflected in the close correspondence of the respec- 
tive empirical density functions. The probability density 
functions clearly show a bimodal structure indicative of 
the (slow) metastable nature of the cc-dynamics as al- 
ready encountered in Figure [TJ The Rossler-driven sys- 
tem, however, exhibits a slight asymmetry of the empiri- 
cal probability density function with one maximum larger 
than the other. This is caused by the only approximate 
numerical estimate of y2 ■ When numerically simulating 
the equation for the slow degree of freedom © for the 
slow degree of freedom of the Rossler driven system we 
approximate the average of t/2 and may write 

dx o -\ ^/ -\ 

^x-x + -(z/2 - y2) + -(y2 - 2/2) , 

at £ e 

where y2 is the numerically estimated average of y2 and 
y2 the true average of y2- Provided a = y2 — y2 = 0(e) 
the centering condition (i.e. the vanishing of the average 
of the 1/e-part of the slow vectorfield over the ergodic 
measure induced by the fast dynamics) is satisfied. Hence 
the corresponding reduced stochastic equation ([T^ is 
modified by an additional small term a/e. This term 
modifies the potential to V{x) = ax* /A — ab^x^ /2 + ax 
causing the slight asymmetry in the probability density 
function as seen in Figure [21 



0.012 




FIG. 2. Empirical density function of the slow variable x 
calculated from a long time simulation with T = lO'' of the 
system (O-Q. Empirical density functions are shown for 
the Lorenz-driven system ©-((HJ (continuous black line), for 
the Rossler-driven system (|9ll- (|12p (dashed line, online red) 
and for the reduced stochastic system (|13p with — 0.113 
(crosses, online green). 



IV. NON-MONOTONICITY OF FSLE SPECTRA FOR 
SYSTEMS INVOLVING REGIMES: NUMERICAL 
SIMULATIONS 

We now numerically determine the FSLE spectra X{5) 
using only data of the slow x-variable for our three cases; 
dni)-® with slow and fast regimes, ©-(HD) with only 
slow regimes and (1131) with only slow regimes. In all 
simulations we initialize the estimation with an initial 
perturbation size of (5o = 10~^ and average the FSLE 
spectra over 5000 realizations. 

Figure [3] shows the FSLE as a function of perturbation 
size 5 for the Lorenz-driven model ([S])-®. For small 
values of the perturbation size 5 we find the well 
known plateau corresponding to the maximal Lyapunov 
exponent which was estimated to be Amax ~ 97.4 (for 

£2 = 0.01)i-^. 

Surprisingly, the FSLE spectrum contains several peaks, 
notably near 5 = 0.0278 and S = 0.0790 in stark 
contrast to the behaviour reported in Refs. [l|-y. Note 
that the FSLE at the first peak is much larger than 
the maximal Lyapunov exponent Amax suggesting a far 
greater loss of predictability at those scales. Initial 
error amplitudes of those sizes experience much stronger 
growth than the eigendirections corresponding to the 
maximal Lyapunov exponent. 

Interestingly, for larger perturbations S the large-scale 
FSLE develops a minimum centred at approximately 
S — 1.1 with Als ~ 0.00428 as shown in the inset, 
suggesting a large-scale predictability time scale of 
around 234 time units. This is comparable to the decay 
time of autocorrelation of the slow variable Tcorr ~ 208, 
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FIG. 3. FSLE A as a function of perturbation size S for the 
Lorenz-driven system (|5l8p with slow and fast regimes. The 
inset shows a zoom for large scale disturbances. 



which is a measure for the transition times between the 
slow regimes. Since the large scale FSLE measures the 
predictability associated with transitions of the slow 
variable from one slow metastable state near a;* = ±1 
to the other, this suggests that the trough in the FSLE 
spectrum is linked to the existence of slow regimes. 
For values 6 > 1.5 the perturbation size is comparable 
to the range of the slow variable which is approximately 
equal to 2.8, rendering the FSLE meaningless. 

Figure U] shows the FSLE spectrum for the Rossler- 
driven system (P))- (IT^ . As in Figure [31 the spectrum 
exhibits a plateau at small scales corresponding to 
the maximal Lyapunov exponent Amax ~ 10.1. Most 
notably for the Rossler-driven system which does not 
support regimes, the large peaks at small perturbation 
amplitudes S that we observed for the Lorenz-driven 
system are absent. Since the small scale FSLEs describe 
fluctuations within each of the slow metastable states, 
this suggests that peaks in the FSLE spectrum are 
suggestive of fast regimes. 

As shown in the inset, for larger perturbations d the 
FSLE monotonically decreases to reach a lower plateau 
with the large scale FSLE Als ~ 0.00227 at the mini- 
mum at (5 1.25, suggesting a large-scale predictability 
time scale of around 440 time units. Here 1/Als is not 
close to Tcorr ~ 234. This is again due to the inevitable 
inaccurate estimation of the mean y2 which leads to 
an asymmetric probability density for x as seen in 
Figure [21 Hence the trajectory resides longer in one well, 
thereby increasing the large scale predictability time; 
the autocorrelation time Tcorr, however, is measured 
for lag times much smaller than the mean residence time. 

Figure m shows the FSLE spectrum for the stochastic 
model (fTSl) with = 0.113, which best approximates^^ 
the full dynamics of the Lorenz-driven system ©-([S]). 
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FIG. 4. FSLE A as a function of perturbation size 5 for the 
model driven by the Rossler system ((9))-H12[) with slow regimes 
but without fast metastable regimes. The inset shows a zoom 
for large scale disturbances. 
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5 

FIG. 5. FSLE A as a function of perturbation size 5 for the 
climate model H13|) with = 0.113. The inset shows a zoom 
for large scale disturbances. 

For small S, the FSLEs of the stochastic system do not 
reproduce the values for their parent systems, and we 
observe no small-scale plateau in the spectrum. This 
is expected as the maximal Lyapunov exponent Amax 
is not defined for the stochastic system. However, at 
large scales S (depicted in the inset) we find a minimum 
of the FSLE spectrum at (5 « 1.1 with Als = 0.00485 
for (7^ — 0.113. This gives a large scale predictability 
time of 206 time units, close to that obtained for the full 
parent model ([5])- ([8]). As for the Rossler system there 
are no large peaks in the FSLE spectrum. 

From these numerical simulations we now formulate 
our main hypothesis which we corroborate in the forth- 
coming Section by quantitative analytical theory and fur- 
ther simulations. We propose that the non-monotonicity 
observed in the FSLE spectra is due to the presence of 
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regimes. In particular, large-scale troughs in the FSLE 
spectrum are an indication of slow regimes whereas small- 
scale peaks are caused by fast regimes. 



V. NON-MONOTONICITY OF FSLE SPECTRA FOR 
SYSTEMS INVOLVING REGIMES: THEORY 

We now explain the numerical observations of the pre- 
vious Section and relate them to the existence of slow and 
fast regimes, respectively. The minima at large scales will 
be explained by calculating most likely trajectory sepa- 
rations supported by a bimodal probability density func- 
tion. The large peaks at small scales will be explained 
by a simple heuristic argument involving rapid switches 
of the fast dynamics between lobes of the Lorenz attrac- 
tor. We denote the perturbation size corresponding to 
the minimum of the FSLE spectrum associated with slow 
regimes by Ss- Similarly, we denote by Sp the perturba- 
tion size corresponding to the peaks associated with fast 
regimes. 



A. FSLE spectra for slow regimes 

The observed minimum of the FSLE spectrum X{S) 
at large scales can be understood by considering the bi- 
modal probability density function of the slow variables. 
Before deriving an analytic expression for the large scale 
perturbation size ds , we give a heuristic argument why a 
minimum in the FSLE spectrum occurs for multimodal 
probability density functions. As seen in Figure [21 each 
of the two maxima in the probability density function 
has a characteristic width of roughly 1.25. Perturbations 
larger than this size therefore likely correspond to a 
pair of trajectories with members residing in opposite 
wells of the potential V{x). Perturbations smaller than 
this size likely correspond to a pair of trajectories with 
members residing in the same potential well. Hence 
there should exist a separation dg with associated error 
growth rate Als such that perturbations smaller than Ss 
will separate quicker, being pulled towards their mutual 
potential minimum, and perturbations slightly larger 
will separate quicker as they are pulled towards their 
respective closest potential minima. 

We quantify this phenomenological argument by esti- 
mating the most likely configurations of pairs of trajec- 
tories which are separated by S. We denote the values of 
the slow variable a; of a pair of trajectories by ^ and 77. Let 
77) be the joint probability function for two trajecto- 
ries which were initially separated by Sq to assume state 
values ^ and 77 respectively. The state values of the pair 
of trajectories ^ and rj are then random variables drawn 
from this joint probability p{£,,r]). For sufiiciently large 
separations the two trajectories will have decorrelated 
and we can treat ^ and rj as statistically independent, 
and approximate p{^,r]) = piOpiv)- We have numeri- 



cally verified this assumption for sufficiently large S. We 
perform the expectation value analytically utilizing the 
reduced stochastic model (IT^ and its invariant density 
([T5|) and set p{x) = p{x). This is justified by the the- 
orems which underpin stochastic homogenization^^' as 
well as our numerical observations (cf. Figure [5]) which 
state that the statistics of the full deterministic system 
converges to the statistics of the reduced stochastic sys- 
tem for e — 0. 

The expectation value S of a location ^ conditioned on 
all possible pairs which are separated by 5 is given by 



S(<5) = - dCd7j^p{^, 



ry)<5(|e - ryl - 5) 



« ^ da m m + m - <5)) , (16) 

where Z is the normalization constant, and the bold- face 
S denotes the Dirac (5-function. We only consider positive 
values of ^, justified by the symmetry of our problem. As 
approximations we assumed statistical independence of ^ 
and rj, and ignored the conditioning of the expectation 
value on the initial separation (Jo- 
in the case of a bimodal probability density function, 
E{S) will decrease initially with increasing separation S 
allowing the pair of trajectories (^, 77) to arrange them- 
selves within one of the two potential wells. For suffi- 
ciently large separations (5, however, S will increase lin- 
early with S and the two trajectories will be in opposite 
wells. The curve of 2(5) obtains its minimum when S Ki b. 

The functional form of the asymptotic linear behaviour 
of the expectation value S((5) for large b can be deter- 
mined by expanding the probability density function p{x) 
around the maxima at a;* = ±1 with 



p{x) ~ exp 



2aP{x - bf 



exp 



2ab'^{x + bf 



Upon inserting this approximation into (1161) a lengthy 
but straightforward calculation yields the asymptotic be- 
haviour S((5) — > 5/2 in the limit of large perturbation 
sizes (5 — 00. 

Following our heuristic argument from above we may 
define the large-scale error perturbation 5s corresponding 
to maximal predictability as the value for which S((5) 
assumes its (unique) minimum. However, we find better 
numerical agreement if we estimate <5s as the value of 
5 for which S((5) is sufficiently close to its asymptotic 
behaviour, i.e. 5^ solves 



S(5s)-^s/2 
S(<5s) 



(17) 



where we chose 9 = 0.01. The two definitions become 
indistinguishable for large values of b. 

To test our analytical prediction we now vary the 
parameters a and b of the potential V{x) in (|4]), which 
measure the height of the potential well and separation 
of the potential minima. In Figure [H] we show a compar- 
ison between 5g as calculated from estimating the FSLE 
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FIG. 6. Perturbation size Ss associated witli the large-scale 
minimum of the FSLE spectrum as a function of the sepa- 
ration b of the potential minima of V{x) for fixed values of 
a = 1 and k — 4/90. The crosses denote values obtained 
by averaging 20000 simulations of the Lorenz-driven system 
©-([H]); the dashed line is our analytical prediction (|17p . 
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FIG. 7. As in Figure El but with k = (4/90)6^ 



spectra using numerical simulations of the dynamics 
of the Lorenz-driven system ©-([S]) and our analytical 
prediction (fTT]). showing good agreement. Note that the 
behaviour is almost linear (however, b not only affects 
the distance between the minima at x* ± 1 but also 
the potential well height). Linear scaling with b can be 
achieved if we scale the coupling k with b according to 
k — >■ b^y/ak, such that the probability density function 
p is invariant upon scaling x ^ bx (cf. (|15p with the 
definition of in ([T4| ). as illustrated in Figure [71 We 
have tested that 6q is insensitive to i) varying a for 
fixed b and also to ii) varying the coupling k for fixed 6, 
consistent with our formula (I17p (not shown). 



Hence, slow regimes and fast transitions between them 
cause the FSLE spectrum to exhibit a distinct minimum 
at large error perturbation sizes, with error growth rate 
related to the average residence time in each potential 
well (or decay rate of the autocorrelation time). 



B. FSLE spectra for fast regimes 

We now present a simple heuristic argument explain- 
ing the observed peaks in the FSLE spectrum \{5) for 
the Lorenz-driven system ©-([HI)- We link these to the 
presence of regimes in the fast process and the switch- 
ing of the fast dynamics between the two lobes of the 
butterfly attractor. Figure [51 depicts the slow x and fast 
2/2 variables of two typical trajectories which are used 
to calculate the FSLE. The slow variable x evolves in 
a step-like fashion with step size Ax. Separations be- 
tween nearby trajectories therefore occur in "units" of 
Ax. Separations of 5 = rnAx can only occur when the 
?/2 components of each trajectory are on opposite lobes 
of the Lorenz attractor. We measured the period of one 
(fast) revolution around a lobe of the Lorenz attractor to 
be Tf K, 0.00691. Integrating the slow dynamics ([5]) over 
one fast period Tf within a lobe and assuming that no 
transitions between slow metastable states at x* = ±1 
occur so that ^ x{t){l — x'^{t))dt — 0, we can approxi- 
mate the step size Ax by 



Ax--T/(|y2|), , 
where {\y2\)t = Jq' \y2\dt. Hence we estimate 



Sv = |Aa 



(18) 



We numerically obtain {\y2\)t ~ 10 as the average value 
of 1 2/2! in each of the fast regimes, i.e. the lobes of the 
butterfly attractor. For our parameters with = 0.01 
and k = 4/90, this yields a step size of Ax w 0.0307 
which corresponds reasonably well with the observed lo- 
cation of the first peak in the FSLE spectrum in Fig- 
ure[3]at — 0.0278. The location of the second peak at 
i5f = 0.0790 is roughly approximated by 2Ax = 0.0614 
according to the above argument. The corresponding 
FSLEs A((5) can be estimated as follows. We assume 
that the separation of slow x trajectories over short times 
t — 0(Tf) is approximately linear, and the initial sepa- 
ration S of trajectories prior to taking a "step" in oppo- 
site directions is small. We define the times tm and t^m 
it takes for trajectories to separate by mAx and rmAx 
respectively. Assuming trajectories initially are infinites- 
imally separated and subsequently move apart at a con- 
stant rate of 2Ax/Tf = mAx/tm = rmAx/trm (where 
2Ax is the separation of trajectories after one step taken 
in opposite directions, see Figure jSJ, the time Tr{'mAx) 
taken for a perturbation of size mAx to grow to size 
rmAx is 



lir - l)Tf 



and so we can approximate the FSLE for the mth sepa- 
ration toAx using ll]) as 



A(mAx) 



2 ln(r) 
m(r — 1)77 
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FIG. 8. Two trajectories obtained from integrating the 
Lorenz-driven system (O-® from nearby initial conditions 
with separation 10~'^, showing short time dynamics of the 
slow X variable, and how increments correlate with switches 
between regimes of the y2-component of the Lorenz-63 sub- 
system, corresponding to the lobes of the butterfly attractor. 




FIG. 9. Perturbation size Sf associated with peaks in the 
FSLE spectrum as a function of the coupling k obtained from 
simulations of the Lorenz-driven system (O-®. The crosses 
denote the locations of the first peak, the circles denote the 
location of the second peak (cf. Figure the dashed lines 
are our analytical predictions (|18p . 



For r = 1.1 we find A(Aa;) = 276 and A(2Aa;) = 138, 
which, given the crude approximations, provide a 
reasonable estimate of the numerically observed peaks 
A(0.0278) = 394 and A(0.0790) = 104 in Figure [S] 

According to our analytical expression for the location 
of the peaks ^TE\i . dp scales linearly with the coupling 
parameter k. This is confirmed in Figure|9]where we show 
6f as a function of k obtained from numerical simulations 
of the Lorenz-driven system ([H])-®- We have checked 
(not shown) that Sp is insensitive to changes in a and b 
for fixed k which would only affect the slow regimes. 



toy model with slow metastable states and fast regimes 
by calculating the finite size Lyapunov exponents. We 
found that the error growth rates can be a highly 
non-monotonic function of the initial error size in the 
presence of regimes. In particular we found that slow 
regimes produce minima in the FSLE spectrum at large 
scales, indicating enhanced predictability. On the other 
hand, fast regimes in the dynamics produce regions of 
rapid divergence of trajectories of the slow degrees of 
freedom, indicating poor predictability at those scales. 
This loss in predictability is found to be far greater than 
expected from the maximal Lyapunov exponent. In 
the context of ensemble generation, either for ensemble 
forecasts or for data assimilation, this means that there 
are initial perturbation sizes which may experience 
stronger amplification than infinitesimal perturbations 
along the most unstable eigendirections corresponding 
to the maximal Lyapunov exponent. Simple analytical 
arguments were employed to calculate the respective 
predictability times and critical perturbation sizes. 
Stochastic parametrizations of the fast processes do not 
exhibit peaks in the FSLE spectrum but as effective 
models of the slow dynamics share the large-scale 
minima of the FSLE spectrum. The sensitivity of error 
growth rate in the presence of regimes suggests caution 
is required when generating ensembles for forecasts 
or when assimilating data on systems with regimes. 
It is pertinent to mention that the signatures in the 
FSLE spectrum of slow and fast regimes occur only if 
perturbations are taken of the slow variables only; if one 
were to measure perturbations over all variables or of 
only the fast variables, the FSLE spectrum would be 
dominated by the strongly chaotic behaviour of the fast 
variables without any large-scale troughs or large peaks. 

Non-monotonous behaviour of the FSLE has been 
previously reported^i^. Discrete maps involving singular 
derivatives such as the circle map are simple examples 
where finite size perturbations can grow faster than 
infinitesimal perturbations. Here we discussed the 
occurrence of narrow well-defined peaks, caused by the 
fast dynamics switching regimes. We note that such 
behaviour was not seen by Boffetta et al.— , where a 
system of nonlinearly coupled fast and slow Lorenz-63 
systems was studied. This is entirely due to the nature 
of the coupling used for which the fast dynamics does 
not induce rapid variations in the slow dynamics; we 
have checked that for linear skew coupling large peaks 
in the FSLE spectrum are again observed. Linearly 
coupled Lorenz-63 systems were for example used to 
model ENSO events'^-S. However, the example of Boffetta 
et al— shows that the existence of fast regimes is not suf- 
ficient for the occurrence of peaks in the FSLE spectrum. 



VI. DISCUSSION 

We have studied the dependency of error growth rates 
on the amplitude of the initial error for a multiscale 



Multimodal probability density functions are not nec- 
essary for the existence of metastable regimes^idS. Bof- 
fetta et al.— found a minimum in the FSLE spectrum 
for a coupled map system which has a unimodal prob- 
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ability density function but dynamics wfiicfi consists of 
laminar phases interrupted by intermittent large ampli- 
tude bursts. This is in accordance with our reasoning 
of a critical perturbation size above which the dynamics 
dramatically increases sensitivity. Further work is re- 
quired to determine how well our arguments transfer to 
unimodal probability density functions. 

We remark that our numerical results were performed 
by estimating the FSLE spectra using the algorithm pro- 
posed by Aurell et ai— and Boffetta et al.—. Our an- 
alytical results, however, do not employ the particular 
method used to calculate the FSLEs, and we expect the 
observed non-monotonous behaviour of the FSLE due to 
slow and fast regimes to hold when other algorithms^ 
are used to estimate the FSLEs. We further remark 
that for higher dimensional slow subspaces the choice of 
norm used to measure separations and to normalize bred 
vectors was shown to significantly alter their statistical 
propertie & ^i^ - . Again, the generality of the arguments 
used here suggests that the choice of norm will not al- 
ter the occurrence of the non-monotonicity of the growth 
rates. This is planned for further research. 
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